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ABSTRACT 


This thesis proposes a design for a DSS that will be used 
by the designers of instruction manuals for enlisted service 
members in the grades of E-1 - E-5 in the Department of 
Defense (DoD). The purpose of this proposed DSS is to help 
authors create manuals that will be easily comprehended by 
service members so they can quickly and effortlessly 
accomplish a task. Current research from the document design 
field and Plain English movement are reviewed to determine the 
best way to structure a written document whose sole purpose is 
adult instruction. The rules for creating the DSS are 


developed from this literature review. 
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I. INTRODUCTION 


A. BACKGROUND 

The two basic tenets of military leadership are 
accomplishing the mission and looking out for the welfare of 
the troops. The mission cannot be accomplished if the troops 
do not understand how to complete the tasks required to reach 
the objective. Since personalized individual training cannot 
be provided to each Airmen, Sailor, Soldier, and Marine, 
training manuals have been developed for completing certain 
tasks. However, these manuals are of no value if service 
members cannot access the information they need quickly and 
easily. 

This thesis examines current material from the document 
design field and Plain English movement to determine the best 
way to structure an instruction manual, so it will be useable 
and understandable. A proposed DSS to help designers reach 


this goal, will be presented. 


B. OBJECTIVES 

The purpose of this thesis is to purpose a DSS that will 
be used by the designers of instructional manuals for enlisted 
service members in the grades of E-1 to E-5 in The Department 
of Defense (DoD). The aim of this DSS is to help authors 


create manuals that will be easily comprehended by service 


members so they can quickly and effortlessly accomplish a 


task. 


C. THE RESEARCH QUESTION 

The primary research question for this thesis is to 
determine what Tactors increase the readability and 
comprehensibility of instruction manuals for adults. The 
factors to be studied are organization, style, visual 
structure of the page, and information access. The secondary 
research question is to determine the best way to structure 


the DSS. 


D. SCOPE, LIMITATIONS AND ASSUMPTIONS 

Scope: This thesis focuses on established literature by 
researchers in the document design and Plain English 
movements. It does not examine experimental theories or 
methodologies in either field. 

Limitations: Specifically the areas to be addressed in the 
DSS are style, organization, information access, and visual 
structure of the page and grade level. 

Assumptions: It is assumed that the officers and managers 
in the DoD would welcome the chance to improve the instruction 
manuals currently used by their E-l’s - B-5’s. ۱٣٣ 
style checkers such as "Grammatik IV" and "WriteRighter" 
primarily check text for grammatical rules only and not for a 


range of style features, content, information access or visual 


structure of the page. Therefore, these checkers would 6 
limited success ET testing the readability and/or 


comprehensibility of instruction manuals. 


E. LITERATURE REVIEW AND METHODOLOGY 

Current material from the document design field and Plain 
English movement will be reviewed to determine the best way to 
Structure a written document whose sole purpose is adult 


Nnustruction. 


F. ORGANIZATION OF STUDY 
cGuapterm T: Introduction 
Chapter II: Literature Review 
Chapter III: Rule Selection and Justification 
Chapter IV: Proposed DSS Design 


Chapter V: Conclusions and Recommendations 


II. LITERATURE REVIEW 


This chapter examines current literature in the document 
design and Plain English field to determine which current 


practices can be developed into rules for the DSS. 


A. OUTLINE 
The information in this chapter will be presented in the 
following manner: 
Two factors critical to the useability of a documeme 
will be examined. These factors are readability 
formulas and comprehensibility. 


2 The limitations in their applications will be examined. 


35 Critical areas that these formulas do not address will 
be examined for their impact on the adult reader. 


4. Specific strategies will be discussed that make 
documents more readable and comprehensible. 


B. READABILITY FORMULAS 

There are two different areas that must be investigated 
when one studies the useability of instruction manuals: 
readability and comprehensibility. 

Guillemette (1987) defines readability of a text as the 
extent that the intended readers are able to read it quickly, 
accept it (i.e. persevere in reading it), and understand it 
clearly [Ref. l:p. 41]. Readability can be measured by 


mathematical formulas that are applied to text to provide an 


er OL how Gifficult the text will be for a given group of 
readers. These formulas measure one or two features of a text 
to produce a numerical value between 0 and 100 or a grade 
level. The features most commonly measured are sentence length 
and word length or word frequency. 

Hundreds of formulas have been developed to predict 
readability for different groups and ages. However, Klare 
found that no "best" formula exists. Of the widely used 
formulas, the Dale-Chall formula is the most accurate and the 
Flesch Reading Scale (FRS) is the most popular [Ref. l:p. 43] 
[Ref. 2]. Another formula that is widely used in business and 
government to test text for adults is the Gunning Fox Index 
[Ref. l:p. 46] [Ref. 3:p. 43]. Since these three formulas are 
SO popular, an explanation of each one will be listed below. 
The mathematical calculations for these formulas are shown in 
Appendix A. 

T Flesch Reading Scale: The formula is based on sentence 
length and number of syllables per one hundred words. 
The FRS renders a number between O0 and 100. The lower 
the number the more difficult the passage is to read. 
The results from this formula can be converted to grade 
levels. 

2 Dale-Chall: The Dale Chall formula counts sentence 
length and frequency of whether a words appears on a 
3000 word list of acceptable words. It yields a grade 
level estimate. 

Se Gunning Fox Index: The Fog Index counts sentence length 


and percentage of polysyballic words (words of 3 or 
more syllables). It also yields a grade level estimate. 


Readability formulas may be used in two ways. First, they 
are applied to a text after it is written to ensure the text 
is written at a preselected grade level. If the grade level of 
the text is higher or lower then the desired grade level, the 
text is revised accordingly. Second, the formulas can be 
applied in the same manner to each paragraph as it is written 
to provide immediate feedback to the writer. Computer editors 
can be programmed to offer immediate feedback on the 
readability of individual paragraphs or text. "Grammatik IV" 
and "RightWriter" are examples of these types of program. Text 
is first reviewed by an editor. Suggestions for better format 
and grammar are then generated. In addition, the grade level 
of the text is determined. 

The question that should be asked here is whether or not 
people should write to formulas. According to Klare (1979), 
experts in the area of readability agree that it is 
ineffective to write to formulas, that is, to change only 
those features measured by the formulas without regard to 
whether or not the changes made make the ,aterials easier to 
understand. He feels the best way to design a text that reads 
at a specified reading level is to use clear writing 
techniques [Ref. 4:p. 125] [Ref. 5]. Klare has developed a 
seven step procedure for using readability formulas when 
designing a document [Ref. 4:p. 125]. 


Apply a formula to see if a piece of writing is likely‏ زا 
to be readable to intended readers.‏ 


2 If the readability index suggests it is, and if other 
requirements for good writing have been met, stop here. 
In other words, that a poor index value predicts poor 
writing, a good index value by itself need not mean 
good meaning. 

S. If the readability index suggests the piece of writing 
is not likely to be readable to its intended writers, 
put the formula aside so as not to be tempted to "write 
60 ۹ 

4. Rewrite the material, trying to discover and change 
those parts likely to cause trouble. Use the formula 
information only as a guide to where to begin. 


Sí Apply the formula again to see if the piece of writing 
is now more likely to be readable to intended readers. 


6. If it is, and other requirements for good writing are 
met, stop there. 


T If it is not, repeat steps, 3, 4, and 5 until an 
appropriate readability index is achieved. 


C: COMPREHENSIBILITY 

Comprehensibility is defined as the reader’s ability to 
perform a task after reading text describing how that task 
should be done [Ref. 4:p. 117]. Since testing a subject’s 
ability to perform a task after reading a text is prohibitive, 
comprehension tests have been developed. There are several 
ways to measure comprehensibility. Two common methods are 
uSing a Cloze test, or a Cloze test and a reading test. A 
cloze test requires the subjects to replace deleted words in 
text (usually in an nth word deletion); a passage with a 
higher mean number of correct responses is considered more 


*eddable.: [Ref. 1:pp. 41-42] 


Several researchers have assigned comprehension scores to 
various passages based on combined reader’s performance on a 
reading and a cloze test. For example, Kincaid et al assigned 
comprehension scores based on the results of the cloze test 
and the Gates-MacGinite reading test. They said individuals 
comprehended a passage when they scored 35$ or more on a cloze 
test of that passage. To determine the reading grade level 
required for comprehending that same passage, they categorized 
the readers into reading grade levels based on the Gates- 
MacGinite reading test. Then, all the readers who fell in the 
Same groups were tested to see if 50$ or more of the readers 
in that group comprehended the passage: that is, scored 35$ on 
more on the cloze test. 

Caylor et al., used an almost identical procedure to 
determine comprehensibility of a text. Instead of using the 
Gates-MacGinite reading test, they used the Kincaid-Flesch 
formula. According to their test, a reader was said to 
comprehend a passage when 50$ or better of the readers in a 
Specific grade level scored 35$ or better on a cloze test for 
that passage [Ref. 4:p. 122] [Ref. 6] [Ref.7] [Ref. 8]. Since 
comprehension test are easy to administer and grade and 
individually testing the users of a text is costly , 
comprehension test scores are commonly used as the sole 
measure of comprehensibility. 

Even though readability formulas are widely used because 


of their ease of application, there is widespread disagreement 


about their value and effectiveness to predict readability and 
comprehension. Redish, Selzer, Klare, Guillemette are a few of 
many researchers who disagree with the ability of reading 
formulas to predict reading levels. Redish and Selzer have 
pointed out five problems with readability formulas. 
Peet. 75:5.) 47) 
7 Readability formulas have been applied to technical and 
business writing with no research basis. 
ae Studies show that readability formulas are not reliable 
and valid predictors of how understandable a technical, 


scientific or legal document will be for adults. 


9. Shortening sentences and words does not necessarily 
make the sentences and words easier to understand. 


4. The underlying assumption of readability formulas - 
that any text. [Or any reader for any purpose can be 
measured with the same equation-does not mesh with our 


current understanding of how people process 
information. 

Dre Readability formulas do not take into account many 
features that are critical to people’s ability to 
understand and use documents: i.e. content, 


organization and layout. 


Klare and Guillemette. in: -discussing the limitations of 
readability formulas state that they do not measure the 
effects of the differing purposes, abilities, intelligence, 
background, expectation ,maturity or motivation in reading. 
Nor do they measure the effects of format, typography, content 
Smart riculty of the text on comprehension [Ret. 1l:p. 45] 
[Ref. 4:p. 121] [Ref. 2]. Schumachler and Waller state that 


readability formulas are too global a level of information; 


they provide little help in determining either how to produce 
a well-designed document or how to improve the design of the 
already existing document [Ref. 9:p. 383]. Guillemette states 
that an early comprehensive investigation into adult reading 
led to the identification of four major categories of factors 
considered useful in predicting the difficulty of reading 
materials: format, organization, style and content [Ref. l:p. 
45] [Ref. 10]. Readability formulas, however, do not provide 
an accurate assessment of these factors because they test at 
most two or three stylistic variables. 

Similar doubts about the applicability and useability of 
comprehension tests also exists. Duffy and Guillemette are a 
a few of many researchers who disagree with the ability of 
comprehension tests to predict -comprehension. Duffy contends 
that comprehension test as they are presently designed in 
principle do not test the "reading comprehension skills 
required to use a text on the job or in training." Duffy alse 
contends 1E is impossible to predict the exact 
comprehensibility of the task; "that is, the task used in the 
development of the test, is grossly different from the 
practical tasks for which texts and documents are used [Ref. 
4:p. 118]." According to Guillemette, one of the major problem 
in using comprehension tests "is deciding upon the nature and 
domain of the questions themselves (i.e., recall vs. 
inference) (Ref. :ا1‎ . 41]." It is a common practice to use 


objective type questions (multiple choice) in many 


TO 


comprehension test. Guillemette states that the use of 
objective questions have been criticized "because of the 
possible biasing effects of subject questioning and question 


Pernilaeron. Ref. ltp. 41] 


DE CONTENT, ORGANIZATION, FORMAT AND STYLE 
In this next section the four factors listed above will be 
defined. The impact they have on the readability and 


comprehensibility of a document will be addressed. 


¡qe Content: Redish and Selzer define content as the 
appropriateness and accuracy of the text. In other 
words, text needs to be designed for its intended 
purpose. This thesis focuses on procedural documents, 
which show -an" individual how to accomplish a task. 
Ref. 3:p.. 50) 


Guillemette defines content as the theme, nature of 
subject matter, and unity of content. Content factors 
affect the interest and compellingness of the material 
for the reader. [Ref. l:p. 42] 


2. Organization: Redish and Selzer define organization as 
the ease of access to the right information [Ref. 3:p. 
50]. It is the use of access devices (i.e. indexes) and 
reference devices (glossaries) outside of the text of 
a document, and the use of titles, headings, purpose 
Statements, topic sentences and internal previews 
Waste 727 a text: Organizational ۶ط‎ 5 impact 
accessibility of the reading material for the reader. 
(Ref. l:p. 42] 


3: Format/Layout: Selzer and Redish define format as page 
layout and typography and the use of graphics [Ref. 
spp 501. 


Guillemette defines format as the size and binding of 
the material; page layout appearance and quality; and 
kind of type and graphical displays. Format factors 
affect the fluency aspect of the reading process. He 
States that fluency can be influenced by a number of 
factors, such as legibility of the basic characters, 


0 


variations in character form and size,and the special 
arrangement of characters on the page. [Ref. l:pp. 48 
42] [Retf. 11] (Ref. 12:pp. 207-3407 


ae Style: Guillemette defines style as semantic and 
syntactic variables,tone of the writer, and the method 
and style of presentation. Linguistic structure or 
Style affects reading behavior. [Ref. l:p. 42] 


Specific strategies will now be discussed to design better 
manuals. These strategies consider the factors that affect the 
difficulty of reading material. These strategies will be 
divided into four specific areas: graphics, organization and 
access of information, visual structure of the page, and 


style. 


E. GRAPHICS STRATEGIES 
Graphics - The author of this thesis defines graphics as 
the layout, design and placement of graphs, charts, figures 


and illustrations in the CEE 


1. | Whenever possible do not present information in prose. 
Research has shown that people extract information more 
quickly and easily when it is presented in lists and 
tables than when it is presented in prose. [Ref. 13:p. 
112] [Ref. 14:pp. 160-61] [Ref. DE 

2. Orient charts so that they are read left to right. 
Charts seem to be better processed if they are read 
left to right. This orientation takes advantage of 
"normal" reading habits and improves reading speed. It 
also suggest that charts should be typeset in the same 
direction as the text whenever possible. [Ref. 16:p. 
81] [Ref. 17] 


oe Use a simple line graph if possible. Simple line graphs 
Should be used to present a few points. One study that 
treats graphs as a independent element finds that a 
simple line graph works better than bar graphs or pie 


12 


charts when the number of points on the graph are few. 
61 


Use colors wisely and correctly in a graph. When using 
colors to illustrate a graph, use only a few colors, 
also, include a legend and use colors in a manner 
consistent with general population stereotypes. Color 
Seems to work as a discriminating agent when it 
includes only a few colors and a careful description of 
chora tionale ftor the color code. [Ret ١6:٣ 8l PRet. 
Ip. £6) Rot. 19] 


Repeat tables whenever they will be used in the text. 
Readers find it more advantageous to have tables 
repeated strategically throughout a text rather than 
having to perform elaborate searches through lists of 
tables and indexes to find an often used table. [Ref. 
pacppe telo iRet.vl6:p. 61) [Ref.-207pp. 3312343) 
(Ret. Ziepo. 75-107) 


Place columns within a table closer together rather 
than spacing them across a page. This makes searching 
easier and reduces additive operations. [Ref. 14:pp. 
1126 11 [Ret :ول‎ 711 ٣۹٤٨6 ۴ 20:2 331343) Ree. 
CUED. LS IO 


Use the best type of graphical display for a specific 
purpose. Studies indicate that tables are superior to 
graphs when looking up and recalling specific values. 
They are also superior to graphs when comprehending 
demographic statistics. Conversely, graphics are 
Superior to tables for subjects asked to compare data. 
On the other hand, Powers et al finds the combination 
of text and graphics is superior when subjects required 
tO make decisions when accuracy is required. 
1۱٣١ 1-1 116۹ يو‎ 2:711 GIS TOF ICEL ADD OS 
Oo | 56 5624-6۹ 005-060۳٣560 79 259pp. 32-39) ٢٠ 
2O BES. S45 SOG 


Limit the number of visual variables, i.e. size, 
value, direction, texture, shape, and color when using 
a visual aid. TOO many visual cues impede 
compreenens on: "Reto dc فص ۳ ,1 ل‎ pp. 595-60 3) 


Be consistent in your organization of graphics from 
section to section and chapter to chapter so that the 
same graphics cues mean the same thing. [Ref. 17:p. 12] 
PRE S265 ps. 29 


نا 


10. Use only those lines, grid patterns, necessary to make 
the information clear. [Ref. 17:pp. 11-12] [Ref. 27:pp. 
5۹95-6021 ٣۹٣٢ 2717 7 


11. Present "one idea per visual" [Ref. 14:p. 14] 


F. ORGANIZATION STRATEGIES 
Organization - organization and information access is 
defined as arranging the content in a logical manner so 


information is quickly and easily ascertained. 


ce Organize the document according to the reader’s stated 
purpose for the text. Distinguish between text used for 
doing and text used for learning. In text used for 
learning, the reader’s goals is to absorb the material 
and remember it for future use. In text used for doing, 
the reader’s goal is to read enough to act immediately 
to make a decision or to follow steps in a procedure. 
A procedural text should be designed differently from 
a definitional or recreational text. [Ref. 10:p. 104] 


2. Make the document user-oriented not content-oriented. 
Put yourself in the user's place and ask questions the 
reader is likely to ask. Then order the questions and 
responses logically. [Ref. 10:p. 104] [Ref. 298:p 1 
[Ref 30:p. د:12‎ (Ret لود‎ 1۳۹ ۶٦ 


Se Include only the information the user needs. One key to 
good business writing is to provide only the 
information that busy people need to accomplish their 
task. [Ret. 13:pp. 04, 110 1٢٣6٣. 28: 26 ٣ 


4. Write headings as questions or verb phrases. Research 
supports that nouns by themselves do not help people 
understand how text is organized. Questions and verb 
phrase both work well for informative headings. 
Questions work well for information sheets and 
brochures. Verb phrases work well for procedural 
manuals 7 131 TON 


S Include a table of contents and an index whenever 
possible. This may be the difference between a useful 
manual and one that sits on the shelf. Index verbs as 
well as nouns and include in the index words that the 
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readers will bring to the document even if those words 
are not in the document [Ref. 13:p. 109] 


D Set up signposts. At the beginning of a document, set 
the overall context by telling the reader what is in 
it, why they might choose to read parts of it, and what 
you expect them to get from it. When you get down to 
the procedure and details, set the context repeatedly. 
Don't just tell them why and under what circumstances 
they might choose to do that procedure, rather than 
another procedure. [Ref. 28:p. 22] 


G. VISUAL STRUCTURE OF A PAGE STRATEGY 

Visual structure of a page - Visual structure of a page is 
defined as the arrangement and layout of type, words, 
sentences and paragraphs in a text to enhance the appearance 


of the text on the page. 


1. Use boldface type to emphasize words or short portions 
of text. Research suggests that when a text has a 
logical Structure, typographic ~—distimetion Such 55 
changes in types, weight, or typeface may help readers 
understand the structure. Research specutrcally 
indicates that readers notice changes in type weight 
(heavy, medium, light) more readily than they notice 
changes in typeface and that readers find very light or 
very heavy type tiring and difficult to read. [Ref. 
1 RETA ORE لد‎ ٢ 57د‎ ۲ 
[Ref. 36] [Ref. 37] [Ref. 32:p. 79] [Ref. 33] [Ref. 34] 


2: Use italics and capitalization when one needs to slow 
down reading rates. Research has shown that italics and 
capitalization will consistently slow down reading 
rates. Their usefulness is in cautions, warnings and 
the like." [Refl 16:٣: 20۱ [REFE J8l Ref. 391 (Bet. 
AO PE 75 0٦۷ 5 ۴۱۱۱4121 422520111 د17 ه4‎ 
٦۸٢٣٣۷٣6۲۰۰٠4300 .۴۰564125501[ 


m Use white space to enhance the appearance of the text. 
Text can be enriched by selectively using certain 
elements that create additional white spaces around 
letters, words, and lines. One can add informational 
value to a text by using selective typography to 
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achieve specific reader reactions, or they can 
judiciously apply certain criterion for 0117 1 7٤٦ 
white space such as word and letter spacing, extra 
leading and paragraph leading. [Ref. 16:p. 81] [Ref. 
29:pp. 36, 38] [Ref. 44:pp 90-905 (Ret. 45: pp. 2ه‎ 7" 
[Ref. 46:pp. 457-471] [Ref. 47] [Ref. 4A8:pp. 39-42] 


4. Choose between a  serif and sans-serif  typeface 
according to the visual tone of the document you want. 
Use a type size of 10 points or larger, two or more 
points of leading between each line, and a moderate 
Mine length: ٤+ 9ب٤‎ 


5. Avoid using all uppercase letters. Research supports 
the conclusion that text printed in lowercase letters 
is faster and easier to read than text set in uppercase 
letters. [Ref. 29:p. 37] [Ret. 49] [Ref. 50] [Ret 51] 
[Ref. 52] 


H. STYLE STRATEGIES 
Style - style is defined as the writer's selection and 
choice of words, sentence types and structure to make the text 


more readable and understandable. 


qs Use personnel pronouns 
26 Use strong action verbs 


EM Include the user in the text. Flower et al "found that 
readers most often converted passive-nominal sentences 
into active-verbal sentences in order to understand 
passages. The researchers coined the phrase "scenario 
principle" to describe text that is "structured around 
a human agent performing actions in a particularized 
Situation." The principle has proven to be one of the 
easiest to teach trainees. The principle unites and 
explains several guidelines commonly suggested by style 
manuals, namely use personal pronouns, active voice, 
and use concrete, specific verbs. [Ref. 53:p. 53] [Ref. 
DJ Dp. 21-2 11۹67.55: 741 


4. Use active and passive voice at the appropriate times. 


Active voice works well if the purpose of the document 
is to stress the consequence of an action. However if 
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ehe TocelvEeEl صا‎ ۱ 6 0712 than the action; a 
passive construction is often the best choice. [Ref. 
SS ey 1 1 717 ۱۱۹70 eels Pi Ret. SSDS IS] ۱١٢ د ےئ‎ 5 6( 


Use Some contractions. Research has shown that readers 
are less likely to see the not when it is not 
contracted. It also generally accepted that the tone of 
a document is less formal when contractions are used: 
RETRO por qe | 


Use ordinary words. 


Present information in concrete terms. More recent 
research has shown that it is not just the length of a 
sentence that affects how easily readers can understand 
it. Material presented in concrete terms is easier to 
understand than material presented in abstract terms. 
Mclaughlin determined that whereas a less legible, more 
diffi ült. version ot a technical pamphlet did mot 
impede performance for highly motivated individuals, 
individuals indicated they would never have used it 
except under duress. Less motivated subjects performed 
significantly worse with the more difficult version. 
Simpler reading materials are generally preferred, even 
when the reader is capable of understanding more 
difficult versions of the same material. [Ref. 1:p. 41] 
1١ 1:71 نن ووو لح 12212 :77 ۹ 2ل نر‎ oe) 
Rebs S59: po. 1-5] 


Avoid Nominalizations. Flowers, Hayes, and Swarts found 
that readers had problems understanding writing that 
was full of passive sentences with noun strings and 
nominalizations (nouns made out of verbs) [Ref. 3:p. 
Al 1٨6 oe SOO: 41-2 6:1۳۹ | Reto pO wl le | 


Write sentences that do not overtax short term memory. 
Propositional density (the number and organization of 
ideas) is more important than the number of words. Even 
in sentences OF reasonable length, grammatical 
Structure can create comprehension problems. For 
example, sentences with extra phrases at the beginning 
(left branching) and sentences with the extra phrases 
in the middle (center embedded) are more difficult to 
understand than sentences with extra phrases tacked 
Saro. Ene VeEnG> (right) branching) per. 5329.54 |) "LIRet. 
ISP A Ret. 7002 pps 4Gl=499) [Ret oli Ref: 62 PpP: 
A د‎ 1 22 TET GAC. LOL OSI 
Oo PE IJ. NISeT eS 6 DD SUE 


Avoid the use of complex conditional sentences. 
senteneesi ot, Enis type are drtfrcult tor readers to 
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TO: 


understand. "Holland and Rose (1981) found out tha 
after a brief initial practice session, people could 
assign themselves the proper condition more quickly and 
more accurately from an algorithm (a paper flowchart) 
than from single prose sentence (Ref. 53:pp. 54-55] 
(Ref. 15] 


11. Line Length. There is a number of opinions on the 
correct line length. According to Tinker ۱) ۶" 
length of 50 to 70 characters is easiest for the eye to 
scan [Ref. 53:p. 55] (Ref. 38) "According tc Peace 
McDonald and Keenan The mean best line lengths for 
passages in different readability groups were also 
different: 44, 50, and 56 characters for the easy, 
medium and difficult groups respectively. Their data 
suggested that line length between 40 and 60 are 
suitable for most “texts. (Rete 67 7p. 104) 

The design of a document includes incorporating the 
guidelines presented in each of the four areas to create a 
easily used document. Following the principles outlined above 
will allow a document designer to produce a useable product. 

In the next chapter the characteristics of the target 
audience, Department of Defense (DoD) E-1's - E-5's, will be 
determined. The guidelines presented in this chapter will then 


be reviewed to determine which ones will be used to create the 


rules for the decision support system (DSS). 


y 
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III. RULE SELECTION AND JUSTIFICATION 


In this chapter the guidelines discussed in Chapter II 
will be reviewed to determine which one will be used as the 
DSS’s rules. The information in this chapter will be presented 


in the following manner: 


A. OUTLINE 


es A profile of the target audience who will use the 
manuals developed from this DSS will be established. 


2. DBuormadtgon above the instruction- manuals currently En 
use will be provided. 


Ss Poor instruction manual characteristics that have 
caused user 1:67 6161116 66 will be discussed. 
Justification for the rules chosen for the DSS will 
also be presented in this section. 


4. Problems caused as a result of poorly constructed 
manuals will be outlined. 


B. TARGET AUDIENCE PROFILE 

In this section a composite profile of the reading skill 
Weel and educational background of DoD E-l’s to E=5’s.is 
established. To achieve this composite, the Defense Department 
Management Center (DMDC) provided a listing of Armed Forces 
Vocational Aptitude Battery (ASVAB) Verbal (VE) composite 
sscres for enlisted pay grades E-l to E-5 for each of the 
different services and for DoD as a whole. The ASVAB VE score 


is important because it can be converted into a reading grade 
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level (RGL). The RGL obtained from the VE scores will be used 
to get an idea of the reading level of the typical instruction 
manual user. Water et al state that: 
A common metric of reading ability has been reading grade 
level (RGL). A RGL scale is developed by administering a 
reading test to students at every grade level (1st through 
post-high school). The RGL scale points are then 
determined in reference to the average score within each 
grade, as reflected by school year and month (e.g. a RGL 
of 9.2 refers to the second month [October] of the ninth 
grade). Ret 6627 Il 
The RGL was used as the sole metric to measure reading 
ability. In October 1988, Brain K. Waters et al coauthored a 
report entitled " Estimating the Reading Skills of Military 
Applicants: Development of an ASVAB to RGL Conversion Table. 
[Ref. 62] 
The objectives of this study were to: 
٢ Measure the reading ability of military applicants 


using six reading tests. 


Ze Select one ASVAB composite (anchor) with which to 
equate the reading tests. 


Qu Equate each reading tests to the anchor. 
4. Recommend a RGL scale for DOD reporting purposes. [Ref. 
GOB. E] 


In the study conducted by the authors, five ASVAB composites 
and six reading tests were examined. The five ASVAB composites 


and six reading tests used in this study are listed below. 
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Composite Name ABBREV. Subtests in 
Composite 


Armed Forces Qualification Test-Old AFQT-O AR+PC+WK+NO/2 
Armed Forces Qualification Test-New AFOT-N AR+MK+2 (PC+WK) 


Verbal VE WK+PC 
General-Technical GT AR+WK+PC 

Verbal (DOD Student Testing Program) VRB WK+PC+GS 

Reading Test Level Form For Grades 
The Adult Basic Learning Examination 3 E ص0 و‎ 

Air Force Reading Abilities Test کہ‎ A AF Enlistees 
Gate MacGinite Reading Test 3 1 (08 2 
Nelson-Denny Reading Test e E OZ 

The Test of Adult Basic Education A 5 626-1229 
Stanford Test of Academic Skills 1 E 812 


AR Arithmetic Reasoning 
30 items that require examinees to solve word problems 
Byprically involving simple calculations. Time limit 1s 36 
minutes 


PC Paragraph Comprehension 
Examinees read several short paragraphs and answer 15 
questions that assess their understanding of what they have 
read. Time limit is 13 minutes. 


WK Word Knowledge 
35 items that require examinees to select the correct 
meaning of the word or to identify a synonym. 
Time limit is 13 minute. 


NO Numerical Operations 
Examinees are given 3 minutes in which to solve 50 items 
involving simple calculations. The test is designed to 
measure calculation speed. 


MK Mathematics Knowledge 
25 items that measure examinees knowledge of high school 


level mathematics (algebra, geometry, elementary trigonometry) 
Time limit is 24 minutes. 


GS General Science 
25 items that measure examinees knowledge of the biological 
and physical sciences. Time limit is 11 minutes. 
Rer. Ge pe. 6, 17. 9) 


The methodology of the study was as follows: 
Twenty thousand, four hundred and twenty-two applicants 


for military service were administered one of the six 
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published reading tests,along with the Armed Forces Vocational 
Aptitude Battery (ASVAB). Tests were given at 15 Military 
Entrance Processing Stations and their associated 214 Mobile 
Examining Team Sites during a Six-week period in spring 1987. 
Order of the ASVAB or reading test administration was 
counterbalanced across testing sessions. [Ref. 62:p. i] 
Study Conclusions were: 
T: The median RGL of military applicants is 10.9 using the 
proposed DOD RGL scale. 


Lm ASVAB VE (WK+PC) is the best anchor test for equating 
ASVAB to the reading tests. 


B The distribution of Air Force Reading Abilities Test 
(AFRAT) total reading scores was closest to the 
distribution of ASVAB VE of the reading tests in the 
Study. “Reb. 609 7٦1 

The- final products of the study are raw conversion tables 
which provide a single DOD RGL scale for each of five reading 
tests. 

Even though DoD commissioned the study, the RGL scale this 
study developed has not been officially approved by DoD. The 
(RGL) scale developed in this study will be used to convert 
ASVAB VE composite scores into RGLs because it makes use of 
readily available data on the E-1's to E-5's currently in the 
DoD. The listing of ASVAB VE scores broken down by rank and 
service complied by DMDC is in Appendix B. This listing also 
breaks down the target population (E-1 to E-5) into high 


school and non-high school graduates. 
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Table I, Total DoD Members at Different VE Scores is a 
listing of the total number of enlisted service members E-1 to 
E-5 in each VE level, by individual service. The purpose of 
this table is to show the number of enlisted service members 
at each different RGL. The RGL that these scores corresponds 
to are also displayed in this table. At the bottom of this 
table the percentage of high school graduates in each service 
is displayed. The percentage of high school graduates was 
obtained by dividing the total number of high school graduates 
in a category by the total number of service members in that 
category. 

Table II, Average VE Scores for DoD Members lists the data 
used to find the average VE score and the RGL for each 
service. The purpose of this table is to show the numerical 
calculations used to determine the average VE score for each 
of the different services. The averages were obtained by 
multiplying the ASVAB VE score by the total number of service 
members with that score. The sum of these multiplications were 
divided by the total number of service members in that 
5٥36707۷ 

The data in Tables I and II are significant because they 
enable us to determine the RGL for E-1’s - E-5’s in the DoD 
and use this RGL as the level at which DoD instruction manuals 
should be written. VE scores for DoD as a whole are presented 


graphically in Figure 1. 
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Figure 1. 1990 DoD ASVAB VE Scores 


In 1980 a vocational aptitude battery, ASVAB, was given to 
a nationally representative sample of nearly 12,000 young men 
and woman between the ages of 16 to 23. The sample contained 
approximately equal proportions of males and females, 
including individuals from urban and rural areas, and from all 
major census regions. This analysis, conducted by the 8:7 ت‎ 
ot the Assistant Secretary of Defense, focused only on young 
civilians who were 18 to 23 years of ace at the time of 
testinc. The results of the testing was SUMA SS in the 7 
publication “Profile of American Youth.” According لل‎ 
profile, the mean RGL was 9.4, the median RGL was 9.6, and the 
Standard deviation was 2.41. [Ref. 69:p. 82] 

The RGL’s obtained from this study and the analysis of the 


data in Tables I and II are presented below. The RGL’s for DoD 


service members and the civilian population are 
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RGL کر‎ iq T 112 T 
presented side by side to provide the reader with a basis with 


which to compare the reading level of DOD service members. 


ARMY NAVY MC Air F DoD Youth 
VE Average S24 S290 S29 0> 0 zl و‎ ٤٥ 
RGL ip 9 337 و1‎ 1١.6 eZ 9.4 
8۶ HS GRAD - 08 82304 720 ٦ DA ۴ 


Mics Dob RG of 11.2 corresponds closely to the 10.9 RGL 
average obtained by the Brain K. Waters et al study. 

To conclude, the average RGL for E-1 to E-5 in the DoD is 
11.2, and 94.09$ of the members in this group are high school 
graduates. 

The question here is why the readability level of E-1’s to 
E-5's is being presented if there are doubts about the ability 
of readability formulas to accurately predict the readability 
of a document. The answer is that readability formulas and 
comprehensibility scores have value if they are not the sole 
criteria on which the readability and useability of a text is 
based. As indicated in Chapter two "experts in the area of 
readability agree that it is ineffective to write to formulas, 
that is, to change only those features measured by the 
formulas without regard to whether or not the changes made 
make the materials easier to understand [Ref. 4:p. 125] [Ref. 
5]." If the reading level of a targeted audience is known (as 


discussed above) and document designers desire to write to 
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that reading level, documents should first be checked for the 
other factors that affect its readability and useability. Them 
the reading level of the document should be adjusted up or 
down to reach the desired reading level. These factors as 
identified in this thesis are graphics, organization jam. 


information access, visual structure of a page, and style. 


C. RULE SELECTION AND JUSTIFICATION 
In this section, Justification for selecting ۷۶ 
selecting individual guidelines will be provided. 


Justeitication”.s base N. 


The profile of the target audience (discussed above).‏ پا 
ae Characteristics of manuals eurrentily in use:‏ 
Se Poor instruction manuals characteristics that have‏ 


caused user difficulties. 


4. The difficulty experienced by the document users as a 
result of poor instruction manual “Ccharacteristicee 


S. Current practices in the Plain English and document 
design field. 
l. Characteristics of Instruction Manuals Currently in 
Use 
8 Their purpose is to provide listings of the steps 
necessary to complete a task, which the user should be 
able tov learn’ irom quickly. 


2 They are normally a collection of instruct iioi 
detailing how to complete a number of various tasks. 
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t Length is variable, and size is proportional to the 
number of tasks being described. Manuals are generally 
longer than 25 pages. 

4. They are generally narrative in nature. 


S They normally include some type of illustrations 
pertinent to the tasks being described. 


6: The listing of steps and procedures should not be so 
voluminous as to discourage use. 
2. Poor Instruction Manual Characteristics That Have Led 
to User Difficulties 
The poor instruction manual characteristics that have 
caused user difficulties are listed below. The guidelines from 
Chapter II which correct/address a specific characteristics 
and serve as justification for the rules used in the DSS, are 
listed immediately below the characteristics it references. 
T Official titles and terms or complex words that refer 
to ordinary tasks that are commonly referred to in 
colloquial terms. 
Use personal pronouns 
Use strong action verbs. 


Use ordinary words 
Present Information 1n concrete terms. 


OO Go 


1. Research has shown that readers often convert 
passive-nominal sentences into active-verbal 
sentences in order to understand passages. 
Researchers coined the term "scenario 
Principle” to describe text that is 
"structured around a human agent performing 
3 11177 2:3 ١ د1 50 5ه‎ 15 ON “lies 
principle unites and explains several 
guidelines commonly suggested by style 
manuals, namely use personal pronouns, write 
in active voice, and use concrete, specific 
Verbs: [Her. p. 17S). (Rebs 9] 
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If information is presented in the simplest 
and most direct manner, information can easily 
be obtained from text. 


Presenting information in this manner will 
lessen the chance that needed information will 
be misunderstood by enlisted service members. 


If information is easy for your troops to find 
and use, it will be used. 


Too many new ideas or concepts are presented in a 


sentence. 

a. Write sentences that do not overtax short term 
memory. 
1. Research has shown that it is easier to 


process information presented in concrete 
terms than in abstract terms. 


If sentences are poorly constructed, their 
meanings may be obscure. This may mean that 
troops will not be able to extract the 
information they need to complete a task. 
Simple direct sentences are the best why to 
present information. 


Too much needless information about a concept or idea 
1s presented in a sentence or paragraph. 


Terms and concepts presented in the manual are not 
defined before they are used. 


3 Include only the information the user needs 


If superfluous informatic y is presented in a 
manual, there is a chan.- that it will be 
acted upon. 


If information is kept simple, there is little 
Chance that it will besmtsuncderstood. 


Presenting only the necessary information ina 
manual saves troops time,as their time is not 
taken up weeding through useless information. 


7 


Directions for completing a task that require the user 
to evaluate the status of a condition(s) is presented 
in a sentence or paragraph vice a flowchart. 
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a. Avoid the use of complex conditional sentences. 


l. Research has shown that complex sentences with 
a lot of prepositional phrases are difficult 
to understand. 


Directions for completing a task that require the user 
to perform a series of steps is presented in a sentence 
Or paragraph vice a step-by-step listing. 


a. Whenever possible do not present information in 
prose. 


l. Research has proven that it is quicker and 
easier for people to read lists than prose. 


2. By presenting information د1‎ 3 step-by-step 
format. The OIC/NCOIC can ensure that all the 
needed steps in a task are completed in the 
right order. This ensures that E-5’s and below 
know exactly what actions to perform and in 
what order to perform them to complete a task. 


Directions and the tables and graphs that support those 
directions are not located in the same place in the 


manual. 

a. Repeat tables whenever they will be used in the 
EON 

pi Place columns within a table closer together 


rather than spacing them across a page. 


l. Research has proven that people would rather 
have tables repeated in a text vice having to 
search for ones previously displayed in the 
2 ند‎ 


2. Research has proven columns in a table that 
are closer together make searching for 
information easier. 


3. When information is repeated where it is to be 
used, it is very easy for enlisted service 
members to have the correct information when 
they need it. Requiring troops to go back and 
search for previously referenced information 
may make completing a task difficult. It is 
hard to follow instructions one place in a 
manual when ES complementary data is 
somewhere else in the manual. 
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Directions are provided, but there are no illustrations 
or they poorly support the directions. 


Use the best type of graphical display for a 
specific purpose. 


Research has proven that different types of 
graphs are better for processing certain types 
Of ٰ پ۹۹"٘۹ٰ‎ ٦ 


a. Tables are superior to graphs for looking 
up and recalling specific values and 
comprehending demographics statistics. 


b. Graphs are superior to tables for comparing 
data Tables and graphs are superior to text 
when making decisions where accuracy is 
required. 


Using graphs and or tables for the specific 
tasks it complements, will enable E-5’s and 
below to extract the correct information 
qicker and easier, thus making it easier for 
them to complete an assignment. 


1 


ay 


There is no table of contents 


Include a table of contents and an index 
Set up Signposts 


A document is easier to use if the reader 
knows the direction the text will take 
throughout the text. 


E-5's and below will be more apt to use a 
manual if the information is easily found and 
accessed. If the information is hard to find, 
it will not be used. 


IE 


dn 
×ط‎ 


There were no headings for paragraphs that introduced 


ideas or for paragraphs that linked together 


new 


different aspects of the same idea. 


Write headings as question or verb phrases. 


Research shows that headings as questions or 
verb phrases helps the user understand the 
text. 


Making the information easy to find or use 
will encourage enlisted service members to use 
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i 


a. 


an 


TOS 


e since they will not get discouraged 
looking through excessive information. 


11. Crucial Information about completing a task which the 
user must know before attempting to perform that task 
is presented in the same manner and format as 
noncrucial information. Crucial information is not 
emphasized, set aside, or highlighted. 


a. Use boldface type to emphasize words or short 
ط‎ 60701-606 GOI LHe tere. 


1. Research shows that highlighting text makes it 
Stand out: 


2. Boldface type can be used to emphasize the 
information that the OIC/NCOIC feels is very 
important and needs to stand out. 


DS Use white space to enhance the appearance of 
تم‎ 


1. Research shows that value can be added to 
information by selectively using white space. 


2. White space can be added to words, sentences, 
and paragraphs to make them easier to read or 
Stand out. Therefore, white space can be added 
to words, etc. to emphasize them or make them 
Stand our. 
Poorly designed manuals cause problems that will impact on the 
users ability to complete the mission. The problems caused as 
a result of the difficulties users experienced from poorly 
constructed instruction manuals are listed below. 


3. Problems Caused as a Result of Difficulties Users 


Experienced From Using Poorly Constructed Manuals 


1. Tasks were completed incorrectly. 
و‎ Tasks simply were not done. 
E Inordinate amounts of time were spent completing tasks. 
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qe Tasks were completed only after going to other 
instruction manuals or having a knowledgeable person 
demonstrate how to complete the task. 
The guidelines established in Chapter two that will serve as 
rules for the DSS have been justified above. The guidelines in 
Chapter two that were not presented in the previous section 
were not selected as rules for the DSS; they did not 
specifically address/correct poor 115 11717 manual 


characteristics that have caused users difficulties. These 


guidelines are listed below. 


D. NON SELECTED GUIDELINES 


1. Graphics (Nonselected Guidelines) 


1: Use colors wisely and correctly in a graph 

oe Be consistent in your organization of graphics Trom 
section to section and chapter to chapter so that the 
Same graphics cues means the same thing. 

Bs Use a simple line graph if possible 

a Limit the number of visual variables, i.e. size, value, 
direction, texture, shape, and color when usin کل‎ 
visual ara 


M Use only those lines, grid patterns, necessary to make 
the information clear. 


Ge Present one idea per visual 
2. Organization (NonSelected Guidelines) 
٧ Organize the document according to the reader’s stated 


purpose for the text. 


2e Make the document user-oriented not content-oriented. 
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3. Visual Structure of a Page (Nonselected Guidelines) 


Jes Choose between a serif and sans-serif type face 
according و‎ 6۹6 visual "Bone ot the document of the 
document you want. 


D 056 1811068 and capitalization when one needs to slow 
down reading rates. 


2 Avoid using all uppercase letters 


4. Style (Nonselected Guidelines) 


I Include the user in the text 

2s Avoid Nominalizations 

Da Use active and passive voice at the appropriate times. 
4. Use some contractions 


S. Line length 


The author of this thesis does not feel she should 
prioritize the difficulties encountered by manual users 
because she cannot adequately predict what problems different 
u. TS Teel are the most crucial. 

In this chapter the guidelines used and not used in the 
DSS were justified. In the next chapter, the system’s design 


Will be discussed. 
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IV. PROPOSED DSS DESIGN 


In this chapter a proposed design for the DSS is 


"۰گ 076 


A. OUTLINE 
The information in this chapter is presented in the 
following manner: 
xS There will be a brief discussion of the cognitive 


factors that effect user interface. Justification of 
the system design based on these factors, will also be 


provided. 
2 The hardware constraints of this system will be listed. 
2 The DSS's design will be illustrated using computer 
Screens. 


B. COGNITIVE FACTORS THAT AFFECT THE DESIGN OF USER INTERFACE 

There are several learning phases an individual goes 
through when he/she learns a new skill. Fitts and Posner 
(1967) have termedethese phases, cognl tii ohase, associo ٢ 
phase and autonomous phase [Ref. 70: p. 169] [Ref 71]. They 


are explained below. 


1 Cognitive Phase: In this phase the beginner attempts to 
understand the skill and is able to crudely perform the 
task using existing 0 1 s. Verbal mediation, 


rehearsal, and extensive feedback are characteristics 
of this phase. 


36 


Associative Phase: In this phase the user attempts to‏ ے7 
learn the components of the new skills. He or she tries‏ 
various actions and gradually eliminates the ones that‏ 
are inappropriate. Because the skills are being‏ 
refined, the need for verbal mediation and low-level‏ 
feedback are reduced.‏ 

Dx Autonomous Phase: The user further refines the skills 
he/she has learned, until the processes become 
increasingly automatic, and less subjective to 
interferences from other tasks. In this phase the user 
may not need verbalization or feedback. 

In the cognitive and associative states of skill acquisition 
a person learns new skills, and refines or reorganizes 
existing skills. As part of this progression, "the nature of 
a person’s knowledge appears to change from an explicit 
verbalizable form to an implicit automatically accessed form 
[Ref 70:p. 170]." These forms of knowledge have been termed 
declarative and procedural [Ref. 70:p. 170] [Ref 72] [Ref 73] 
[Ref 74]. Declarative knowledge is characterized by the fact 
that one is required to interpret and process new facts that 
have been articulated to them. Procedural knowledge is 
characterized by the fact that one accesses direct knowledge 
of physical phenomenon or mental processes. The processing of 
declarative knowledge requires much use of working memory 
because the interpretation and manipulation of knowledge is 


gEnecr control rather than occurring automatically. [Ref. 7Q0:p. 


iva) Ref. 75]. 
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Ce SYSTEM DESIGN JUSTIFICATION 

Because one is unfamiliar with the material being 
presented and feedback is constantly needed, this process is 
Slow and laborious. Because the user will only use this system 
when he/she is developing an instruction manual, it is 
anticipated that their skills will never become automatic. 
Therefore the system is designed as if the user is in the 
cognitive learning phase and manipulating declarative 
knowledge. Comprehensive instructions are given, extensive 
feedback is provided, and minimal computer skills are required 


to use the system. This is evidenced by: 


15; The extensive guidance provided in Figures 2 - 4. 

ze The simple layout and design of the rule selection 
Screens Figures 5 - 8. 

7 The layout and guidance provided in the recommendation 


screens. Figures 10-14. 


D. SYSTEM HARDWARE CONSTRAINTS 

The system is designed to be displayed on a 19" full page 
monitor. This is a very important requirement because visual 
structure of a page is one of the variables that the DSS 
checks pages of proposed manuals against. An individual using 
the DSS will not be able to adequately evaluate the way 
information is presented on a page if information is shown on 
a space 1/2 to 1/3 the size of a page. A page’s dimension are 


defined as 8 1/2" by 11". 


20 


E. PROPOSED SYSTEM DESIGN 

The system is designed to provide feedback after the user 
has completed a proposed page in the manual. After a page has 
been completed, Figure 2 will appear. It tells the user about 
general instructions. After Figure 2 is displayed, Figure 3 
will be displayed, telling the user how the feedback will be 
displayed. It explains what types of advice the system 
provides and allows the user to select the type of advice they 
prefer [Ref. 76:p.49]. To select the type advice to be given, 
the user chooses a critic. The critic used in Figures 10-14 is 
active/positive. After the user chooses an expert, Figure 4. 
will appear on the screen. It tells the user what factors the 
DSS uses to evaluate the proposed page. It allows the user to 


evaluate their proposed page using: 


1 all the rules for all five variables 
Wage selected rules for a single variable 
ome selected rules for a combination of variables 


This DSS can check each page for all five variables in 
tandem or it can check the page one variable at a time. If the 
second method of evaluation is chosen, the  systems's 
recommendations will be displayed one factor at a time, in the 
order the factor's where chosen by the user. The evaluations 
are iterative, in that each subsequent evaluation incorporates 
the previous recommendations. The order the factors were 


chosen in this thesis are graphics, style, organization, 
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visual structure of the page. After the user selects the 
factor he/she would like the page evaluated for, Figures 5-8, 
the rules for each factor, will appear. These screens allow 
the user to select the rules they want the DSS to use when it 
evaluates a page. 

Figure 9 is the user’s proposed page design. Figures 10 - 
14 display the system’s recommendations as it goes through the 
iterative evaluation process. 

The user has the option to save the changes, print the 
changes, to precede to the next evaluation, return to the rule 
selection screen or exit the program,after each evaluation. 

The important feature of this DSS is its ability to 
provide recommendations the user should follow. The system 
provides recommendations only; -it does not arbitrarily change 
the user’s text or design. 

In this chapter the design for the proposed DSS was 
displayed. The final chapter will be conclusions and 


recommendations for the entire thesis. 
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General DSS Instructions 


General instructions for exiting the program and moving between the 
levels of the program are presented below. These instructions can 
be used at any level of the program. 


To return to a previously selected screen/level 
l. Push the ESC Key 


2. If you are at this screen and hit the ESC key 
youre wlll EXIT Cut ot the program. 


To Exit out of the program from any place in the program 


ھ2 ۰۰۰۲۰۰۰۰۰ 


To use previously selected rules from your last session 
ENH SHIFT F3 


2. The rules you choose to use for a session are automatically 
saved when you exit the program. 


3. When you push SHIFT F3 here, you go automatically to the 
recommendation screens. 


TO continue with the program hit any KEY. 


Figure 2. General DSS Instructions 
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This DSS is designed to provide recommendations about a 
proposed page of the manual, after you complete that page. 


The feedback will be presented in the following manner, 
two pages will be displayed side by side. 


The Left Hand Page - Will be the user's proposed 
page design. 


The heading on the TOP of this 
page will read User's Proposed 
Page Design. 

The Right Hand Page- Will be the critic's recommended 
page design. 
The heading on the TOP of this Page 
will read Critic's Proposed Page 
Design. 


This DSS has four types of critics, that will be explained 


below. 


The user can select the type of advice he or she would like to 
receive, by activating that critic. 


To. activate ae Cio: 
l. Move. the cursor to the desired critic 
2. Press the ENTER key. 

Critics 


Reactive: a reactive critic will make comments about what the 
user has done. 


Active: an active critic suggests what the user might do or 
proposes criteria the user should consider 


Positive: a positive critic praises a supe ' r design or 
complains about an inferior design. 


Negative: a negative critic complains about unsatisfactory 
designs and does not praise useful or interesting 
designs. 


ke | [Sess | BEES | Necativa | 


Figure 3. DSS Introductory Screen 
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Tate DSS provides advice’ on five factors that affect the 
design of a manual. 


The DSS can check each page for all five factors, but it can 
enly check the page one factor at a time. 


However when you select a factor you can select more than one. 
The DSS will check for each factor separately, in the order you 
selected the factors. There will be a separate page of 
recommendations produced for each factor. Each subsequent 
recommendation will incorporate the previous recommendations. 


There will be a final recommendation that incorporates 
all the recommended changes. 


Graphics: The layout, design and placement of graphs, 
charts, figures and illustrations in the text. 


Organization: Arranging of the content in a logical manner 
so information is quickly and easily ascertained. 


Visual Structure of the Page: The arrangement and layout of 
type, words, sentences and 
paragraphs in a text to enhance the 
appearance of the text op the page. 


Style: The writer's selection and choice of words, 
sentences, sentence type and structures to make the text 
more readable and understandable. 

Grade Level: is the grade level at which the document is written 
this will automatically appear as the last 
recommendation. 

Final All: produces a version of the page that incorporates 

the recommendations from all the rules in all 
factors. 

Final Select: produces a version of the page that incorporates 


the recommendations for only the factors and rules 
the user selects. 


Visual Structure of Page 
[Style | Final All | [Final select | 


Figure 4. DSS Factor Selection Screen Graphics Rules 
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Graphics Rules 


The rules the DSS uses to evaluate the graphical quality ofa 
proposed page are listed below. You can choose the rules 
you would like the DSS to use. 


How to choose the rules: 


1. Move the cursor to the YES or NO box 
and push the ENTER key. 


a. Choose all the graphics rules 
b. Whenever possible do not present : 
information in prose. 
٥ہ‎ Oriente charts southey are ۲۹ لو1‎ 
to FONE. | Yes 
d. Repeat tables whenever they will be 
used in the text. Yes 
e. Place columns within a table closer 
together rather than spacing them | Yes 
across the page. 


f. Use the best type of graphical 
display 1173 316 0م‎ 6۴ ۱ Yes 
ce 


Figure 5. Graphics Rule Selection Screen Organization Rules 
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Organization Rules 


The rules the DSS uses to evaluate the organization 
proposed page are listed below. You can choose 
pue rules vou would like the DSS to- use. 


How to choose the rules: 
































MOVE the cursor to the YES or NO box 
and push the ENTER key. 


a. Choose all the organizational rules EM 
Y | 
A 
b. Present زو‎ the information the ےج‎ 
user needs. eee 
C. Write headings as questions | 7 
or verb phrases | res 
d. Include a table of contents =e 
| Yes | 
L) 
oc 1-2 6666 ۲ 
| Yes 
= 





Figure 6. Organization Rule Selection Screen 


Visual Structure of a Page Rules 
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ور 





Visual Structure of a Page Rules 
The rules the DSS uses to evaluate the visual structure of a 
proposed page are listed below. You can choose the rules you would 
like the DSS to use. 


How to choose the rules: 


1. Move the cursor to tne YES or NOOO 
and push the ENTER key. 


a. Choose all the visual structure rules 
b. Use boldface type to emphasize 
۷۶۶٢۹۶٠٠ ۶۹٠٢) Of 


the text 


c. Use white space to enhance the 
appearance of the text. No | 


Figure 7. Visual Structure of a Page Rule Selection 
Screen Style Rules 
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Style Rules 
The rules the DSS uses to evaluate the style a proposed page was 
written from are listed below. You can choose the rules you would 
like the DSS to use. 


How to choose the rules: 


1. Move the cursor to the YES or NO box 
and push the ENTER key. 


a. Choose all the style rules 
e] 


b. Use personal pronouns ERE 
Yes | | No 
— 





C. Use strong action verbs | 
Yes No | 


d. Use ordinary words em 
d | Yes | No | 


e. Present information in concrete | 
terms. Yes | No 

f. Write sentences that do not overtax | 
short term memory Yes 


g. Avoid the use of complex condtional 
sentences. Yes 





Figure 8. Style Rule Selection Screen User's Proposed Page Design 
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User’s Proposed Page Design 


To use a checkbook, you need to do several things: The 
money deposited into the account should be recorded in the 
ledger, The payee should be recorded in the ledger, The 
number of the check should be recorded in the ledger, the 
date of the check should be recorded in the ledger, The 
amount of the check should be subtracted from the previous 
balance, the new balance should be recorded in the ledger. 


Figure 9. Proposed Page Design That The DSS Will Evaluate 
Critic’s Proposed Page Design (Graphics) 
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Critic’s Proposed Page Design (Graphics) 
To use a checkbook, you need to do several things: 
1. The money deposited into the account should be recorded in 
the ledger. 
2. The payee should be recorded in the ledger. 
3. The number of the check should be recorded in the ledger. 
4. The date of the check should be recorded in the ledger. 


5. The amount of the check should be subtracted from 
previous balance. 


6. The new balance should be recorded in the ledger. 


Recommendations: 
1. You should consider presenting the information ina list 
vice prose. 


2. There are no illustrations, you should consider adding 
them. 


3. The reading level is ninth grade 


4. To return to the rule selection screen hit shift Fl 


Save changes ? SI | 
Yes| No | 














Print changes ? کرجا‎ 
TEST f wo 

















Check next factor + [EE ze 
No | 
Yes | O | 
Exit- Program? pw ve 
| Yes! || No 
AAN ———ÀMÀ 


Figure 10. Graphics Recommendations 
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Critic’s Proposed Page Design (Style) 
To use a checkbook, you need to do several things: 


1 Record the amount of money deposited into the checkbook 
in the ledger. 


2. Record the payee in the ledger. 
3. Record the check number in the ledger. 
4. Record the date the check was written in the ledger. 


9. subtract the amount of the cheex, from the previous 
balance. 


6. Record the new balance in the ledger. 
previous balance. 


Recommendations: 


1. You should consider making the sentences active vice 
passive. 


2. You should consider replacing the highlighted words 
with simpler words. 


3. Words that are both highlighted and underlined are 
misspelled. 


4. The reading level is ninth grade 


5. To return to the rule selection screen hit shift Fl 


Save changes ? 
Print changes ? 
Check next factor ^? 
Exit Program ? 
re) [ro 


Figure 11. Style Recommendations 
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Critic’s Proposed Page Design (Organization) 
How do I use my checkbook ? 
1 Record the amount of money deposited into the checkbook 
in the ledger. 
2. Record the payee in the ledger. 
3. Record the check number in the ledger. 


4. Record the date the check was written in the ledger. 


O uwonbtrdct the amount. of the check, from the prevgpous 
balance. 


6. Record the new balance in the ledger. 
previous balance. 


خښ ce‏ س سے سے سے سے سے س ee ec‏ 


Recommendations: 


1 711 should consider writing this sentence as heading. 
You should consider making the heading a questions 
or verb phrase. 

2. The reading level is ninth grade 


3. To return to the rule selection screen hit shift Fl 





Save changes ? - 7 
Yes | | No 
L سوج‎ [Lm e 
Print changes ? 
Yes ' No 
Check next factor ? Tz: ہے‎ 
| Yes |». NO 
Exit Program"? 
Leon No 
> A IN ow e 


Figure 12. Organization Recommendations 
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Critic’s Proposed Page Design (Visual Structure of the Page) 
How do I use my checkbook ? 
1 Record the amount of money deposited into the checkbook 
in the ledger. 
2. Record the payee in the ledger. 
3. Record the check number in the ledger. 
4. Record the date the check was written in the ledger. 


5. Subtract the amount of the check, from the previous 
balance. 


6. Record the new balance in the ledger. 
previous balance. 


Recommendations: 


1. The page layout looks find, there are no recommended 
changes. 


2. The reading level is ninth grade. 


3. To return to the rule selection screen hit shift Fl 


Save changes ? 
Print changes ? 
Check next factor ? 
e] [e] 
5730 6 + 


Figure 13. Visual Structure of a Page Recommendations 
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Critic’s Proposed Page Design (Final All Recommendations) 
How do I use my checkbook ? 
1 Record the amount of money deposited into the checkbook 
in the ledger. 
2. Record the payee in the ledger. 
3. Record the check number in the ledger. 
4. Record the date the check was written in the ledger. 


5. Subtract the amount of the check, from the previous 
balance. 


6. Record the new balance in the ledger. 
previous balance. 


Recommendations: 


1. This is the final recommendation for the page, 
it incorporates the recommendations for all the rules 
in all five factors. 


2. The reading level is ninth grade. 























save changes ? | [S 

ares NO 
Print changes ? = = 

۲65۱ No 

Check next page ? mee 

Yes || | No | 

تت لو اا 070ھ و 
Yes | | No‏ | 

8 








Figure 14. Final Recommendation That Incorporates 
All The Changes 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 
The DSS proposed in this thesis had been designed to 


evaluate -instruction manuals IOI five factors: 


e Graphics 


2a Organization 
oe Visual Structure of a Page 
4. Style 


EN Reading Grade level 


Current literature in the document design and Plain English 
field has been examined, to develop the rules for this system. 


The system allows the user to select: 


e The type of advice he/she would like to receive 


2 The factors and rules they would like the DSS to use 
when it evaluates an instruction manual 


y 


Finally, the system produces a series of 1: ommendations based 


on the evaluation factors and rules the user selected. 


B. RECOMMENDATIONS 
The purpose of this thesis was to propose a design for a 


DSS, which will help document designers develop instruction 
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manuals that are readable and useable. Since the actual system 


was not built, it is recommended that: 


ie A follow on thesis be done to build the system. 


2. Another thesis be done, after the system is built to 
test and revise the system. 


Se After the system is built and tested, that the system 
be “distributed throughout Dob. 


SUED 


APPENDIX A 


READABILITY FORMULAS 


206.835 — (79865 ٦77 1-7٣ 


3.6365 ۸ ) 1,9 maw) + (046 CN 


Flesch-Scale RE 


Dale-Chall ESO 


Gunning Fog GR = .4 * (np + sl) 


reading ease 

word length (number of syllables per 100 words) 
average sentence length in words 

percent of words not on dale list of 3000 words 
grade  [Ref. 1:p. 43] [Ref 77] [Ref. 78:pp. 1١ ل۷‎ 


[Ref. 79] 


56 


wl 
sl 


ndw 


gr 


APPENDIX B 


DMDC ASVAB VE SCORE 


FOR DoD E-1'S —-E-5’S 


ات 


BY SERVICE AND RANK 
PAYGRADES El - ES 


ARMY 
| i PG | | 
| ق‎ _— | | 
| ۱ 1 ۱ 2 ۱ S | 4 | 5 | TOTAL | 
|-------- R---------- f-------~-- ass honor herceoroo-on I —X | 
| VE | | | | | | | 
|-------- | | | | | | | 
l0 | x | W . | 1 1l 
| -------- 4R--------- pesce Jue A - (— اځ‎ 4R---------- | 
120 | el 31 11 3l ۸۱ 151 
| -------- honor Rc سو‎ a [oc ee pere —— | 
121 | 1 | 10۱ 9| 21 ا22‎ 
| -------- p a سر‎ puel. jeu. c اس مالس با لہ کک ےا‎ | 
122 | 2 | 7 sal ll ]! 
| -------- horno +---------- }---------- łt---------- سس سس سس سے سا ل4ہ‎ henna رر‎ ۱ 
23 ۱ 7 | RI st 21 21 
|-------- $---------- PE os NE E ۳227-06 ور کے کک کک‎ $---------- ۱ 
124 | 2l | 4l " 2| 21 
|-------- tensas —X—— —— | کک ی کک کا ت‎ R-------- | 
126 | 7 | 5 7 21 4| 
|-------- $---------- Pess 8ۃ‎ EES M ccce e —— M $-------- | 
27 | l | al ۸ 16| 181 
| -------- 42.--------- qc rcc تن کب == ہک سال‎ EEE T c | 
128 | £l JI . | 4 14| 19| 
| -------- $---------- کک ہے کو و‎ do fae ee oe horno ا ا ا نا تا س س س کا‎ | 
129 | 21 1 6۱ 6۱ 211 421 
| -------- R------.--- A po ل = دک‎ $---------- | 
130 | xl | 1 131 59| 791 
|-------- o و‎ JO a کی‎ d E سر‎ eee Ei ccc پل( ئځ مت اد‎ | 
3 ۱ El 2| 2| 321 791 115 
|-------- سه م مه د 2د د د-1 و = ی کے ےا‎ poc ocu ا ع‎ 
132 | 4| 1 121 40 | 1361 1931 
| -------- +---------- pee E jore uu diee eed وه ےر‎ hormona ł---------- 
133 | 8| 51 21 | 84| 185| 309| 
|-------- te--------- و ا ا سس د‎ om E E E +---------- +---------- 
34 | 71 7 ا58‎ 172| 299| 543| 
| -------- țt---------- $-22-2-2.2--2-2- ا‎ parias > A 2 222 horno ماس ما‎ | 
135 | 111 171 501 176| 337| 5911 
|-------- مس شر‎ ———M arca ca — hr ———— 
136 | 171 201 1121 298| 546| 993| 
| -------- $---------- R---2-2-.-- precor سس سس سے سال اس اہ 4 کے کک کک و‎ 
137 | 351 58| 2811 7021 1385 | 24611 
|-------- henna oa A eee ere eae E ec... .> osas. 
138 | 60 | 90| 360| 8191 10221 23911 
|-------- $--+-------- +0008 ى-‎ —— 4---------- ł---------- ł---------- | 
139 | 95 | 1781 743| 15131 12541 3783 | 
| -------- وس د د‎ —— os es q A A qoc OS 
140 | 1201 208 | 1161 1548| 1346| 3938| 
|-------- کے‎ +2 E E EEE EEE Pa henna | 
i | 2241 3211 J071! 19901 16501 52561 
E ے722‎ A ee CCE 
142 | 2911 4101 13181 24551 18121 62861 
|-------- $-.-------- == دد یه و‎ ene ا اہ سد رہ‎ ——— = | 
143 | 4111 5321 1594| 2943| 20711 7562| 
| -------- ها دد اد‎ ee وس سو کے ےت‎ [ouo o c (ces Po ut | 
144 | 782 | 10751 3076 | 5986 | 2111 13676| 
| -------- +---------- 1 poca e 4 Heron — +---------- | 
D: | 907 | 10731 2652 | 46621 2585 | 11879| 
--2--.---- Emo lo ooo NOl 
146 | 9771 11551 3033 | 55601 2843 13569| 
|-------- R-I-------- ———— کک ا‎ se EE ł---------- ł---------- | 
147 | 12391 1400 | 336] | 5794| 29331 147271 
| -------- —— کو شر سد بد اس‎ SS EE ea 4$-2---2..----- ł---------- | 
148 | 17301 20601 5336 | 10084 | 3856 | 23066 | 
|-------- +---------- horno ESSE ے2‎ 2 2-72 4$2----2.----- R---------- | 
E: | 1759 | 19931 4423 | 6952 | 32421 18369| 
—— ———— —— I د کد د‎ 
150 | 25261 29841 57521 8291 | 3804 | 23357 | 
(CONTINUED) 
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BY SERVICE AND RANK 
PAYGRADES El - E5 


=a mam qu» qu ou um a Ke ہم‎ A جو سے پس سل ہے سے سو پس ې سه‎ A És A م ےچ ہی ہے‎ AA A ہے سے سے‎ ew qum cum um um dus VA um dE dus V UA dus dus dus dm 


PG ۱ ۱ 

ا 71 70777078 27173 کے تم 
ol AO‏ 

| | | ۱ ۱ 

| | | | | 

2068 | 2337 | 48101 76391 36251 20419۱ 

A‏ جح 
تو ...ےت 1 
29897 امه 109121 66 اا 6021 n‏ 
00 60د BIO‏ 56521 وو mul‏ :ھ0 
E a 75 0 9 ٤‏ 
رد B 245i 35m! ei I8 — elo!‏ 
او ات اک اه 2538 ES 2I!‏ 
e T Ment 1+ ٤‏ .رر E‏ 
C XC BN C eT‏ 7 
.و E sol "ql‏ 
ers jio xni — pe — 3»4| — x38 855i‏ 
p E ae ey‏ 
iei ee a 1٢ 372 319481‏ 

NU 344401 39784] — A33 1515841 80884] — 396029] 
I 351951 434361 966211 1629)4] — ارو‎ 


مس س حم ےھ سه ہت سه سب سی مس مس pe‏ جےي حب m m ey‏ سب جب سب حہ سب پس سې سے مت نه - ہے ہے جے مہ ہہ ہے ہے ہہ ےھ ہے ہے ہے په پس په سے ہے مه ست مه اب e e c wm meg‏ کے da du‏ 
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BY SERVICE AND RANK 
PAYGRADES El - E5 


NAVY 
| | PC | | 
| HA | | 
| | 1 | 2 | 3 ۱ 4 | 5 | TOTAL | 
| -------- +---------- $---------- 4---------- ł---------- B --.---22--- horno | 
| VE | | | ۱ ۱ ۱ ۱ 
|-------- | | | | | | | 
120 | 31 21 1| 1| 1| gl 
|-------- $---------- $---------- 4-----.---- $---------- RO----2.-2---- س سے سے سے لہ‎ ۱ 
21 ۱ | 1| 111 21 1| 151 
| -------- RO --------- RB --------- herra Pee eae eee ٣ سس سا ساس سا امہ سے لہ و و‎ | 
123 ۱ 1 | ۱ 1 21 31 
| -------- +---------- +---------- === == سس‎ $---------- Horno س‎ | 
125 ۱ A | | 1 7 11 
|-------- $e oe een nee $---------- +----~----- 4-2-2-.--2-2--- $---------- R-------2--- | 
26 ۱ a 7 ۱ 1| ا3‎ 4| 
| -------- ات مہ سا ال کات لہ‎ p وو ددد دد د‎ mccum hernan ساس سے ساس اس مہ ساس سے ہہ‎ | 
127 | al 2] | 1 4| 5| 
| -------- $-------~-- hormona. = eee +-----+----- 4RÓ--------- 4R---------- | 
128 | al ll 1] l 6l 8l 
|-------- $---------- ee (een. see d 4R---------- RO --------- | 
129 | 1| sl 4] 4| 9| ا18‎ 
| -------- شر‎ oe سه‎ A E 4= -e0 +---------- $---------- | 
130 | 2 | 21 2! 9| 151 301 
| -------- $=-<--------- pocas cu. 1 5222 و د وړ‎ eS sesos R--------- | 
131 | 21 3 11۱ 14] 321 621 
| -------- ساس سے سس سے سے سس لہ‎ pool. puc. ===> 4$---------- R---------- | 
132 | 4| 7 111 191 ا38‎ 791 
| -------- a= === == ا ےا ي مە‎ +---------- R-----2----- Fun == === | 
133 | 71 141 22| 45| 701 1581 
| -------- +---------- $---------- ساس سس اس ساس سے کہ سا لہ ت ا‎ $---------- 
134 | 131 261 41۱ 104| 89| 273| 
| -------- +---------- f------~--- ee eee HE ا‎ horno == heno ہہ‎ | 
135 ۱ 21۱ 35l 48| 109| 149| 362| 
| -------- o I fo laver aeu کا‎ M $---------- R---------- 
136 | 291 88 | 1171 1661 1531 548| 
| -------- 4 --------- po a e a مەم ا 2 هد‎ R---------- سس سے سے سے ماس لہ‎ | 
137 | 81 | 1861 2691 3 528| 14571 
| -------- ł---------- R--2-2----2--- poro aa 42-2--2------ +---------- $---------- | 
138 | 1211 2091 3571 4531 424| 1564| 
| -------- R--------.- $---------- jo > ie $---------- RO --------- $---------- 
39 ۱ 1961 4241 7421 847| 578| 2787| 
| -------- R--------- کک = عا دا دن 5 دا‎ ae —— ——— | 
140 | 2421 4601 698 9401 6951 3035 | 
|-------- Posadas. pa ه2 سا دک‎ 7 0 A 
141 | 4171 7101 9491 10731 832 | 3981 | 
|-------- += —— Poocues-eceu Earn a rr د ری و = د کاب لو‎ 
142 | SIN 843| 1169] 13331 9741 4838 | 
| -------- henna دمه د د سے‎ pool A er m s ——— € | 
143 | 757| 10621 14191 Io, 11521 6011 | 
| -------- hon $-e-—----- Pasan کہ دہ ہے‎ ——— 4R---2------- | 
| 44 | 12461 19101 29081 3084 | 15321 106801 
|-------- A) La دخ‎ jeans n ———— اسما ماما‎ | 
ie | 1338 1788 | 2098 | 23061 15491 90791 
— 4$------2224------2-.224-222222-2224--2-22-2-2222204----222--2-224--2-2-.2-2-2--2-- 
146 | 1491 | 19151 24701 27001 1788| 10364| 
|-------- R--------- —————— د‎ $---2-.--2--- homo henna 
147 | 15391 20481 26311 2744| 19301 108921 
| -------- 4$---------- e EEE کے — :ہ7‎ $---------- $---------- 
148 | 2108 3056 | 4355 | 47401 25511 168101 
|-------- —— AS E eee pa ےہ جح‎ $---------- p 
|49 | 21241 2530! 3066 | 3340 | 22111 133311 
| -------- سل لا تہ کہ‎ ee دد‎ oe ت ن‎ 4$-2--------- 
0 | 21601 3300 | 3689] 4063| 2636| 16448| 
| -------- R--------- ps aE p $---------- $---------- 
151 | 2088 | 26191 32831 3904 | 2748| 14642| 
|-------- horno. اس سے سس سال سا 4ہ‎ E A RO--------- horno 
152 | 21611 21131 3202 | 40541 29201 151701 
(CONTINUED) 


PAYGRADES El - E5 


NAVY 

| ۱ ۲0 ۱ | 
| | den o | | 
| | 1 | 2 | 3 | 4 | 5 | TOTAL | 
| -------- —— Pra ea ہہ شال‎ REA CE 1 کد ددد د ددد د دل د‎ == | 
| VE | | | | | | | 
|--~----- | ۱ ۱ | | | | 
153 | 2318] 33275] 5025 67961 42691 217331 
|-------- a + ---------- pure ددد دي و‎ += R---.-2.------ 
154 | 25711 3349| 43201 66111 5886 | 221311 
| -------- ——— سے‎ pcc. c E lL کا د‎ has aa. de 
[55 | 21421 2855 | 34211 50211 3969| 174081 
|-------- 2 e Pera an pouce یت‎ ———— 42-22-22 $----2--2.---- 
i | 24121 31661 3753 | 6072 | 44201 198231 
— —— ————— oro nr ooo rro toro rr tr a 
157 | 2423 | 3698 | 4763 | 91631 61971 262501 
|-------- 4-2--------- د هد دځ و‎ Hanon 7122-2 9۷0 ہیں‎ ee 4=» 
158 | 15461 2326 | 30639 | 6049] 4669! 17659] 
| -------- t2.-.--.-.-.---- us ===> 2 ے2‎ A EA 722902 EE R---.---2.---- | 
159 | 1336 21881 33371 66691 53621 18892 | 
|-------- R--------- ł---------- سس ——— ۳۰ سح سے سےا ساسا سے 4 په وساد ې‎ 
160 | 948 | 17461 2808 | 5961 | 51451 166081 
| -------- $---------- ساس سد اس اہ اس ہے اس ہے سے "4 سے الہ سد اس سا ساس کا لہ‎ {=== = ļ---------- T —X—X 
161 | 425| 886| 1935| 50051 48231 130741 
|-------- $---------- puer (o ToS. کے ےد‎ poo E hormona | 
162 | 1071 2631 1821 7981 | 3427 | 15701 
--+----- t----------ł----------ł----------ł----------ł}----------t----------| 
| EDUC | | | | | | | 
— | | | 
I NON HS 35751 52911 4119۱ 6334| 5758| 25837 | 


1 سس ا 6يرل تلو لم و ما کی کھت 


| 
+ 
[HS GRAD | 318231 445231 62069! 920761 68089 2985801 
* * 4 4 + 4 
| 


| سے سے me mu cee‏ کے سے سے ہے 2717 272 د د 2 22 2775 222 222 2 21252 2-2 22 د 2ه 22 2-2:21 کے a‏ 
3244171 | 13847 984101 668481 498141 | 35498 


سے ہے ہے سه ہے ہے ہے ہے ہے ہے سی سی پس سی ټی سے ټی سی سی بپ سے ہے حه حد سه سل مس سے ہے ہے ہے ہے ہے ہے س س س س س ت س س ت ت س ت ہے ہہ ہے سر rrr D‏ 
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BY SERVICE AND RANK 
PAYGRADES E] - &5 


MC 
| | PG | | 
| ق‎ -— | | 
| ۱ 1 ۱ 2 i 3 | 4 | 5 | TOTAL | 
| -------- $---------- o E بد 2 دا‎ p łt---------- | 
| VE | | | | | | | 
|-------- | | | | | | | 
120 ۱ 7 21 1! 1| 1 5 
| -------- $---------- $---------- 4-2--------- hr $---------- $---------- | 
21 ۱ ۲ 7 4| 7 . | 4| 
|-------- 4$---------- $---------- $---------- $---------- سا سے سد سے حا سا سے ہہ سس سس اس ساب نا‎ | 
125 | 21 i | T ]! 1| 
| -------- سا سس سا سے سے 4 دد دوو دنه || اا >= سا ا اس اس سا لہ‎ hernan | 
128 | 1| أ‎ | Sl 1! 2 | 
| -------- $---------- $-2--------- Poses aoa = ee $+---------- hernan | 
129 ۱ | A | 7 ]! 1| 
| -------- === == 4R--------- #---------- ML. o E 4R---------- hormona. | 
130 | Bl . ۱ 31 3| 6١ 
|-------- $-2-----.---- $---------- po - ۸ سس سس اس سے سے ساس اس‎ ł---------- horno | 
31 | 7 2 3| 1| 3| 9| 
|-------- R---------- EEE سات تبع که کیل بل تم د‎ A M +---------- horno | 
132 | 1 ٦ | :. 6l 1١ 
| -------- horno 1 —X—— تک ت نے هتت تح بتک دو د ددد لل‎ | 
183 | 3| : 1| آ5‎ 11 161 
| -------- 2 Veo seca ae Poon eee S Hora R----22---2-- | 
134 ۱ ]! 31 8 | 9| 101 311 
|-------- 4$--------- o. سا سے سے سے اع‎ $=-------=-- 4---------- R---------- $---------- | 
135 | 21 5| 7 151 161 451 
|-------- o اکت ر 6ر کے کا کے‎ Horna {---------- 4R---------- honor | 
136 | 3i 101 25 171 39| 94| 
|-------- $---------- ju a و‎ pec e 2 Porra 4 ---------- | 
137 | 3l 18 49| 651 1381 213۱ 
|-------- $-------—- 2= Pros aa رر‎ E M Hn porno - | 
138 | 18| 301 86۱ 65| 1051 304| 
| -------- ت‎ E E 4—---------- سس سس اس سے سا ا 44ہ ----------$ کات اس سا ا سا 4ہ‎ 
39 | 251 501 2141 1491 1361 5741 
|-------- —M— س‎ d ——M € + کک‎ +---------- | 
140 | 42 | 75 2501 1761 1931 736| 
| -------- tos == e pu O ae MS oe EE سا ات سا 4ہ‎ 4$2--------- 
| 4] | 49| 1311 3181 254 | 258 | 10101 
|-------- homo ساس ساس سے لہ‎ o 4---------- (——— E ccc دس دمام‎ 
142 | 85 | 1321 4101 3031 324| 1314| 
|-------- 4R---------- 1 E e pl c ته ههه‎ 4= === = 
143 | 138 | 224 | 6561 441۱ 315 18341 
|-------- A ł---------- $}---------- E et 4£-2--------- horno 
144 | 2371 4441 1466 7101 433| 33501 
|-------- $---------- 4R---------- d--2-------- puce R----.------ 4$-2--------- | 
145 | 3001 558 | 128) | 6681 5111 33181 
|-------- 4£2--------- $-----2-.-- سب داماد ےت[ ا و و ق‎ 4£-2---2-2----- 4£-2--2------- 
146 | 361 | 587 | 1647 | 848| 5861 4049| 
| -------- 4--------2-- و شد د‎ —— paa هس دا د ې‎ $---------- 
147 | 4291 7061 17741 915] 6581 4482] 
|-------- fan aos A ee د کو‎ eee a E deeem mas m ¿oca eec 
n | 5461 10771 34591 16511 1521 7485 | 
-——------ q---------2-2.4-222-22-22.-2-4----.2-22.22.42222.2222224----2-2-2-22224-.----2----- 
|49 | 602 | 10311 ۸41۱ 12021 1381 6004 | 
|-------- fs a o O E هګ خد |و‎ 7َ E 4$2--------- R---------- | 
150 | 850 | 145) | 32361 14851 8071 78291 
|-------- dcc e A ۷ ! د 2- ک کت ددد کت‎ 02 $---------- 4$-2-.-------- 
i51 | 654| 1204! 29711 ] 4211 8761 71381 
|-------- he Festa uo EE bau ro ee hero MO O | 
152 | 6661 12721 31481 1595] 8651 15461 
| -------- ———— gam jt Pani== ==>. R-------.-- R---.------- | 
153 | 8161 15311 41911 27331 11501 110211 
|-------- += === === jm ———— 2 p ا‎ O 4-2--------- R---------- | 
154 | 846| 15711 41911 24601 17251 10743| 
|-------- هماما‎ T سےا سے ساس ساےہ‎ ¬ gg سس سے اس اتا ما سے4‎ t---------- 4---2------- 
155 | 7281 1285! 3235 | 18501 10501 8148 
(CONTINUED) 


BY SERVICE AND RANK 
PAYGRADES EJ - E5 


MC 
| | PG | | 
| ق‎ | | 
۱ ۱ 1 ۱ à | 3 | 4 | 5 | TOTAL | 
|-------- 4$--------- —— (nu os EE E 4-2-22 سال مہ اس اہ سال -دد2-2 د‎ 
| VE | ۱ | | ۱ | | 
[-------- ۱ ۱ ۱ | ۱ ۱ 
56 | 7761 15101 3625| 2108| 11101 1 
| -------- t2--------- pa p ددد‎ 02620722082 22 hormona $---------- 
157 | 7611 16001 4785 | 31491 13461 116411 
|-------- 4$2--------- lae. کد‎ pec IH ههه اسر اسان مہ ےل === ساسا 4 س‎ 
158 ۱ 5201 10981 21921 18931 11361 74391 
| -------- Pc porc ou henna. A سا ساس 4ہ د هصح د‎ 
159 | 482 | 1045! 28701 19501 11231 74701 
| -------- tae ae eee ee $------+-~-- #---~------ و‎ e BR----.-.----- horno | 
160 ۱ 3281 887 | 22:121 15691 10331 6089 | 
| -------- R$-----2----- ———— Pasa se some a $---------- +---------- 
161 | 1741 421| 1599 13021 892 | 4394 | 
|-------- t---------- +---------- == = === horno =~ $---------- 
162 ۱ 421 1221 764| 7841 5091 2241۱ 
-------- $---------2-4----222-2-2-4-.-2---2---22-4-2222-2-2-22-24-2---.2-----4----------| 
| EDUC | | | | | | 
-------- | 
INON BS | 71 1474! 2803 | 13921 20791 88791 
|-------- RO--------- ox ue plc eu کی مات کے ےک‎ a R------2-- | 
IHS GRAD | 39 18564 | 5557] 300761 16838| کت‎ 
|-------- łt---------- $---------- $2-----2-2--- Pc EE ان هه سن او‎ BR---------- 
ITOTAL | 10488] 200381 544551 31868| 189171 1357661 


- e am Gm GR GR 4e "D 4e "D UD ىہ‎ UD GR UD ce جم ہے ہم یت‎ eww ہے ہہ حبص ہے په بې سه س سه سه‎ wee ہے ہے‎ ooo o ÅÅ å سے سے‎ o oo 
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DY OBRVICK AND RANK 
PAYGRADES El - E5 


AF 
| | PG | | 
| l------------------------------------------------------ | | 
| | 1 | 2 | 3 | 4 ۱ 5 | TOTAL | 
| -------- ł---------- ł---------- $---------- $---------- Porn $---------- | 
IVE | | | | ۱ ۱ | 
|-------- | | | | | | | 
121 | ۲ 1 11 Hl | 21 
|-------- +---------- $---------- کے‎ feina +---------- $---------- | 
127 ۱ 2 l zi " 1 11 
| -------- łt---------- ا ای کی‎ ES کد‎ n $---------- | 
128 | 4 2 ‘I 21 1| 3l 
|-------- +---------- $---------- $---------- +---------- -.--------- $-.--------- | 
129 | zl al a 1 11 ۸1 
|-------- ł---------- R---------- En کے‎ EEE Em ——— $---------- | 
131 | E] ۳ al 4| 1 5| 
| -------- ł---------- ł---------- ł---------- {---------- +---------- $-2------.--- | 
132 | zl 7 a 2l 6| 8| 
| -------- +---------- $---------- 4---------~ ن‎ R-------2--- hernan | 
133 | al | " 5] 6l 111 
| -------- $2-----.---- R---------- ("0(1 2ھ‎ 4 A BO--------- R-------- | 
134 | M | 2 Jl 121 191 
|-------- $---------- $--------- ہے رہ کش کل‎ d£2-2--2------ $2--------- $------.---- | 
135 | . al 3l 131 201 361 
|-------- 4$2--2------- +-------.-- toon come cee { --~------- $---------- 4$---------- | 
136 | a 1| ا2‎ 26| 38l 671 
|-------- $---------- سے ساس سے سے سے اس ساس ا لہ‎ Qe ue esr o ا‎ $---------- łt---------- | 
137 | al 2 | 51 1011 148] 256| 
| -------- = په ار‎ ILES ene on ae === 4$-2-2-------- لہ‎ -------- 
138 | 2| 4| 101 1061 1091 2311 
| -------- p ls کت د‎ = === $---------- | 
139 | 8l 5| 321 1711 148| 364| 
|-------- honran R------2--- ecu E و‎ vs $--------- ł---------- 
140 | 4| 161 251 2731 2501 5681 
| -------- سر سو رت کر ہر شر‎ a A 4$---------- —XX—— 
14] | 121 273 54 | 387 | 297 | TIS] 
| -------- $---------- n ISO [LEE ہر‎ $---------- 
142 | 24| 401 1071 634| 474| 1279| 
| -------- +---------- $---------- eS e یَصس بج("‎ $---------- 4$---------- | 
143 | 43| 61۱ 55| 9711 544] 17801 
|-------- $--.-----.--- سا ا ره د د2د ا‎ FEE ł---------- $---------- 
144 | 68| 1731 355 16741 692 | 29621 
|-------- ا‎ een E کے ےک نے کا ت ۲ دوو نل دک د دو‎ $---------- 4$-2--------- | 
145 ۱ 118۱ 2391 ا4406‎ 17601 897 | 3460] 
|-------- $---------- ł---------- د‎ 2 2 honorem horca R--------- 
E | 1871 3341 1521 24611 1085 | 48191 
—— $-e----4R-Ó--2-e----4-22-22-2--24-.--2-22-222-2-24--.2--2.-222-2-4.--2.-2-22-2- 
z | 2361 480| 945| 2982 | 13201 و‎ 
سا اس می اس مم اس سے لہ ہمہ‎ 4# u ooo bronco oo ee 
E: | 380 | 786 | 1805 | 52061 16591 98361 
— 4de-2--2-22224-----22.--|].---2222--].-.-- ee a a a fa a ae eee eee 
149 | 4931 9061 17491 4508 | 1801 | 9457 | 
| -------- $---------- مود ددد د‎ jc MN PE ل‎ += == ===> 
50 ۱ 736| 1384| 24111 5469| 1943| 12003| 
|-------- $---------- $---------- ۲-0 دص‎ p $---------- honran | 
e: ۱ 7531 1307 | 2696 | 55321 21921 Ke 
سا ہہ‎ A 2 2222222 د د21‎ OS 
152 ۱ 8291 15601 29101 58401 24321 136311 
| -------- $---------- $---------- ےب ان ہد ہہ ہش رنه و‎ ł---------- henna | 
153 | 950 2062 | 4845 | 92381 2687 | 197821 
|-------- $o--------- E م‎ ee —XX— descr E | 
ps ۱ 12661 2438| 48101 102431 55231 ا‎ 
وس سو‎ 4$---------2-4--2-22-222-2224p--222222224-2222222222422222-22224-.-2--2-2--2--- 
155 | 10501 18651 38501 65381 30011 163101 
| -------- $2-----.--- و د ددد د‎ {=--------- ł---------- $------+--- R--------- | 
156 ۱ 11381 21301 4521 | 73211 31391 182551 
|-------- honor ج س س س‎ ———— jo و‎ {ane e $---------- horno 
51 ۱ 12731 25771 62471 103311 35781 240061 
(CONTINUED) 
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RY SERVICE AND RANK 
PAYGRADES El - F5 


AF 

PG ۱ ۱‏ ۱ | 
| سد ت ت ت | | 
TOTAL |‏ | 5 | 4 | 3 | 2 | 1 | | 
p 722-27 pl LP pcc ree ge R---------- |‏ --------| 
I VE ۱ ۱ | | | | |‏ 
۱ ۱ ۱ | | | | --------| 
|16380 |3362 |6443 40501 16451 | 880 | 158 
ł---------- |‏ ت e Par ar‏ ه E oe‏ ----------$ --------| 
]17554 |3754 69021 ]4450 16181 8301 ۱ 9 
| م ---------.-4 >= سا Ped‏ 2 26ے ےت ى9 7022۰0 --------| 
149271 34711 | 5788 | 3837 11751 655 | 160 
| ----------¢ ----------4 سس سے سے سے سس لے سپ د ودن دو ----------# łt----------‏ -------- | 
117681 | 3067 | 4882 71 ]28 | 664 | 338 | 161 
| سم مہ سے اس ساس سس لہ سا اہ سا ساس سا 4ہ سرت و EE‏ وی سو ہم ےھ See‏ ہر ---------=-+ --------| 
| 6603 18701 31391 13261 2081 601 | 162 
oe jore ee 0 7 Se |‏ ا a‏ —— --------| 
i |‏ ۱ | | ۱ ۱ سو 
| | -------- 

INON HS | 89۱ 1651 225| 3411 2961 11161 
-------- 4o ت ساس سد رد سد ت 4 س‎ af ae a سد لد بد‎ 
IHS GRAD | 122441 23546 55106 | 1086251 492441 248765] 
-----2--- 4 4 ono ono hon | 
ITOTAL | 12333] 23711! 55311] 108966 495401 249881 | 
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BY SERVICE AND RANK 


PAYGRADES El - E5 

TOTAL 

PG | |‏ | | 
| | ا ق | 
TOTAL |‏ | 5 | 4 | 3 | 2 | ] | | 
uec" hernan. $---2-22--- |‏ و و سے 0 کک ----------$ --------| 
VE | | | | | | |‏ | 
| | | | | | | --------| 
|1 | 7 !1 | |. | 10 
oe 4$-2-2--2--2.-2-.-2- +---------- 4$-2------2--- |‏ ہے ا دص يد2 دال ----------+ --------| 
i 9| 5| 4| 28l‏ 31 | 120 
ł---------- $---------- +---------- +---------- +---------- ł---------- |‏ --------| 
431 ا3 DTI‏ 261 21 |1 | 121 
| ----------+ ---------4$2 سیت س کے کک 22 EE‏ === -------- | 
xl al 11 1|‏ | . | 122 
4p---------- === +---------- |‏ دوو 2 ----------+ ----------+ -------- | 
51 |4 ]1 7 | " ۱ 23 
ł+---------- ł---------- q moon $e ł---------- +---------- |‏ -------- | 
xl 73 2l 21‏ ۱ 7 | 24 
$o--------- ۱‏ ----------+ ----------$ --------~-$ ----------$ ----------$ -------- | 
21 |1 |1 7 | 2 ۱ 125 
ee poe MO E 42-2--2-2-2-2-2-- +---------- R-----.----- |‏ --------| 
3l 5| 8|‏ | . | 3 ۱ 126 
| ساس سس سا 4ہ کے کات کے 2 >2 +4 A == oa‏ اس لت R2 ---2---- Bac‏ --------| 
ul | dal 3] 211 24]‏ | 27 
e +---------- R$-2------.-- |‏ == = ده || ----------+ ----------+ -------- | 
321 )22 6۱ | ] 21 |1 | 128 
| سس اع ساس سا ہہ EE ce o5‏ == === ----------+ ----------+ ----------$ -------- | 
|63 ا38 ]11 101 1 31 ۱ 29 
R-2--2-22---- pe osa > Lona. +---------- $+--------- |‏ --------| 
2l 7 9| 251 ٧۷ 1151‏ ۱ 30 
ee hor ==>. |‏ اه q ono nm (ae eee‏ حلندکنت نت نک ته == === -------- | 
2l 8| 16 51| 114| 1911‏ | 131 
R------2--- |‏ سس تتت po TOO‏ کہ مے کے ےت 4 qs‏ ----------+ --------| 
8l 23| 66| 186| 291|‏ |8 | 132 
----------+ سے سس اس سا مال ا 2 p‏ ----------+ --------| 
|494 2681 1391 501 191 ]18 | 133 
a +--+-------‏ —— ددد ددد د د و R-------- Hon.‏ --------| 
| 866 401 2921 1071 361 )21 | 134 
E ł+----------‏ د دد په کپ د د د دد اځ و O‏ ----------$ ا -------- | 
SS | 34| 57! 1081 313) 522| 1034|‏ 
سا ا اع امہ اس اس ا لہ ----------+ ----------$ A A e e‏ --------| 
17021 |776 | 507 2511 1191 491 | 136 
وب همح ت و و ES Par aa a o‏ == د-4 --------| 
|4447 2107 12611 | 604 | 264 ]119 | 137 
p R$-2------.--- |‏ ————— سا B. ---.----- mg o gcc‏ --------| 
44501 16601 14431 8131 333 | 201 | 138 
tr... =‏ 0 غد دد د ددد ړ ا ات یدل ې Nooo ooo‏ -------- | 
is | 324| 6571 17311 26801 2116 Ew‏ 
هج هص م ت ت ت د ت ت ت ت ت ت ت ت ا م تت ات | ت fa Sm a‏ --------2 
E | 4081 7 16891 2997 2 2484 | 8277 |‏ 
4R----------4--.-2---2.-2-2-224.--..---2.--4--------- -222-222224-22--2--2----‏ -------- 
!11020 | 3037 | 3704 | 2392 11851 7021 | ]14 
R-2---.-----‏ هه مسوم —— SS‏ ----2-----$ ----------$ --------] 
13۱۱ |3584 |4725 | 3064 |1425 9191 | 142 
سس سس 4ہ سا سس سا سا ات ام لہ لہ مع هد نا کا 2 ee‏ ده || ---+-------$ -------- | 
171871 ]4142 59761 38291 1885 ]1355 ۱ 143 
يا د face wees Pr‏ ا ا Pas Hess E qe‏ سس سس سا سے سا ماس 4 === =+ -------- | 

| 30668 54141 115141 | 7805 | 3602 23331 | 144 
R----------‏ ----------+ دح ES‏ ----2------$ ----------# ----------+ -------- | 
211361 |5542 |9396 |6477 | 3658 | 2663 | 145 
| ----------+ ----------$ هداد ده و E OSa dre REDE‏ ع --------| 
328011 63021 115691 19221 39971 30161 | 46 
R------2-2-2-- fosa.‏ کاک کک os‏ طابر ال Jl A‏ --------| 
sl | 3443] 4634 | 8711! 12435] 68411 36064 |‏ 
قد لد لد لد وره هم و اوو وو وه و و اوه سا سا سا ا لا A‏ سے ٣ہ‏ ہے ےت اع ات 
]5197 88181 | 21681 149551 69791 |4764 | 48 
ee hr nono ł----------‏ ----.-----4 ساس سے ساس ساس لی لہ ł----------‏ --------| 
| 47161 | 8052 160021 }11669 64601 49781 ۱ 149 
(CONTINUED)‏ 


PAYGRADES El - E5 


TOTAL 
| | PG | | 
| | oo | | 
| | ] | 2 | 3 | 4 | 5 | TOTAL | 
]-------- 4$---------- $---------- boro 4 س س مہ اب ت ت‎ 4---------- horno | 
IVE | | | | | | | 
|-------- | | | | | | | 
z | 68721 91191 151481 193081 91901 59631 | 
یی ا ا ا و د هه ون ون د د ړک هګ هف د د د د سن ی‎ € 
D | 55631 74671 137661 185021 94411 bie 
-------- 4$e----——---4$----------4-2-22-2-2-2-2-2-4-.---.-2-252-4----2-4---------- 
is | 57201 8074 | 143461 19397 | 99101 d 
—— $Ó-----—---—4---------24---2-2-2-2-2e-24-.2-2-2-2-2-2-2--4---22---2-2--4---------- 
[s | 6546 99651 21685 | "0۲ 13322 1 83341 | 
— ——-A^——^—-—-—-«-«—^—-«-—»———————————————— eee 
El | 18151 105481 19948| 202261 95001 87597| 
-------- ہہیا‎ 222224 2 2-22-222122-2 222-2٥2 24 22:2 2:02:22 a e 
= | 6241 | 8897 | 161581 215181 119421 647561 
clle tonne wee eee tee eee das 
me | 71221 10031 | 180541 24874 | 131021 131831 
=== اس ساس اع اس سے سے لہ‎ o nf a ت ت‎ en tenn | 
157 | 74021 ae ا‎ d ae 95508 | 
|-------- ¢---------- هک د دن د دد وکن د هه دح و د د دح نی و‎ a a E 
158 | 5047 | 1107 149771 220711 135311 633331 
|-------- +---------- ł---------- ساسا‎ a HMO 
159 | 4785 | 74661 161221 237541 151021 672291 
| -------- سے اس سے مهه ومر سم لا ههاوو سم ہے ہے :کہ‎ 4e-----2-2-.-22-4-.----2----- 4$----------4---------- | 
e | 37261 5924| 135 1 ۷ھ‎ 141161 51 
-------- ¢----------4--~------ +f ~~~ ~~~ + 4 ee te et = + ----- | 
16] | 19071 0 96211 171521 130291 44942 | 
|-------- ہک ہر ہک کہ رک اہ ہہ ہر رہ ہیں — ہس اس ساس سے اہ سا لہ‎ foo See owen tae eee ee qero 
162 | 44] | 77 41541 108881 8844 | 25249| 
|-------- 4$-2--------- $-2-2-------- A poc کے ده‎ $-2--.------- R$---------- | 
| EDUC | ۱ ۱ ۱ ۱ | | 
-------- | | | 
HN HS 58501 105821 ال" ا‎ 158601 671801 


ہے سے ہے سے m m æ m‏ 
ہے ہہ ہے ہے ہے ہے m mae‏ ~- ہجے e o mo =o‏ ہے  -‏ — سے ہے ےہ سه سه ہے ے ہمہ سے سے ہے ہے ہے سے سے ہے ہے کے ہے - ہے ہے سر ہے ہے سي ہے ټی جو ہے 


سے ہے ہت سے ew‏ سے ہہ ہہ ہے ہے ہے ہے مسب سم ہت سب مب مب ہت ہہ مسب ہت ہت ہت ہت ew ew‏ سب ےت ew ew‏ سے سی ہے سے سے سے چس سے سه ہے ہے سے سه ہہ ہے سی ہے کہ کہ ې سی سی ےک ہت ہہ ہے ہے ہے aue UP UD‏ ہب سب بپ سب ہی يی سب پر سب ڼب حم ہے = 
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